Artificial neural network technology for lips reading

The paper presents the use of neural networks for task automated speech reading by lips articulation. Speech recognition is performed in two stages. First, a face search and area selected separate frame video sequence using Haar features. Then frames goes to input deep learning convolutional recurrent viseme recognition. Experimental studies were carried out independently obtained videos with Russian-speaking speakers.